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Abstract 

Utilizing hierarchical linear models, this study of 144 private 
schools (72 Catholic and 72 non-Catholic schools) drawn from the 
National Education Longitudinal Study of 1988 discovered that 
Catholic school students scored lower in reading than students at 
non-Catholic private schools. Analysis of internal school 
characteristics suggested that lower growth in reading 
achievement might be related in part to lower student morale in 
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Catholic schools. However, we found no significant differences 
between Catholic and non-Catholic private secondary schools in 
the development of students' math, history/social studies, and 
science abilities from eighth to tenth grades. This study also 
identified important student- and school-level variables such as 
Catholicism, gender, risk factor, parental involvement, and 
enrollment size that help to explain the outcomes. 

Comparison of academic achievement for Catholic versus public secondary 
schools has been an active field of research for nearly 20 years, beginning with 
Coleman, Hoffer and Kilgore's (1982a, 1982b) analysis of 1980 High School and 
Beyond (HSB) data, which found a positive “Catholic school effect.” This work 
has been grounded in social capital theory, which explains the Catholic school 
advantage in terms of the value for young people of being embedded in a 
network of relationships, in this case a network based on religious association 
(Coleman and Hoffer 1987). Subsequent studies have either lent support, albeit 
sometimes qualified, to their findings (Bryk, Lee, and Holland 1993; Gamoran 
1992; Hoffer 2000; Hoffer, Greeley and Coleman 1985; Jencks 1985; Jensen 
1986; Keith 1985; Marsh 1991; Marsh and Grayson 1990; Riordan 1985; 

Sander 1996) or called them into question (Alexander 1985; Gamoran 1996; 
Graetz 1990; LePore and Warren 1997; Noell 1982; Willms 1985). 

Coleman et al. (1982a) noted that findings of public-private school comparisons 
could have implications for policy decisions and parent choices — implications 
that have become even more salient today. A decade later, however, Witte 
(1992) argued that in studies with proper controls, achievement differences 
between public and private schools were too small and uncertain to have policy 
import. Nevertheless, school choice advocates have relied heavily upon 
Coleman et al.'s findings (Chubb and Moe 1988); and the Catholic school effect 
contributes to legal arguments for inclusion of Catholic schools in voucher plans 
in cities such as Cleveland, Ohio. Voucher systems are predicated on the 
argument that market competition among schools will produce higher 
achievement in all schools, without increasing costs. Catholic schools may 
appear to have an advantage over other private schools in a market model 
because of their relative efficiency (though costs are rising, see Bryk, Lee, and 
Holland 1993; Harris 2000) and their effectiveness with disadvantaged urban 
students (Hallinan 2000). Urban school reformers also advocate making the 
core curriculum and sense of community found in Catholic schools part of public 
school restructuring efforts (Bushweller 1997; Hudolin-Gabin 1994). 

Few studies, however, have compared Catholic schools with other private 
schools to examine whether any achievement effect is associated with the 
schools' Catholic status or simply with their private status. Ornstein (1989) 
reports both similarities and differences between Catholic and other private 
schools. Private schools in general are smaller than public schools, but Catholic 
schools are larger on average than other privates. Catholic schools are also 
reported to be more urban, and their demographics include more ethnic 
minority, immigrant, and low-income students. Private and Catholic schools both 
have more stringent academic requirements for graduation than public schools, 
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but Catholic schools have the highest graduation rates despite their less elite 
student populations. Coleman et al. (1982b) found that both Catholic and other 
private schools exhibited higher student achievement than public schools, but 
private school students showed higher self-esteem and “sense of fate control” 
than either public or Catholic school students. However, the category “other 
private schools” in the HSB database was very “heterogeneous and 
amorphous” (p. 11), because the sampled schools varied so widely in purpose, 
size, sustainability, and other characteristics (a limitation also noted by Noell 
1982). Bryk, Lee and Holland (1993) argue that even if achievement differences 
are not supported, Catholic schools serve the common good by producing more 
than test scores. Catholic schools, these authors contend, are moral 
communities that emphasize equity and social justice rather than individual self- 
interest. In contrast, they noted that other private schools serve a greater variety 
of purposes and a narrower range of students. 

Using data from the High School Effectiveness Supplement of the National 
Education Longitudinal Study of 1988 (NELS:88), Lee et al. (1998) compared 
math course-taking in public, Catholic, and independent secondary schools and 
reported that in all private secondary schools students on average take more 
advanced math courses. Catholic schools were especially notable for more 
math course-taking among a broader range of students. However, this study 
had a limitation in that baseline math scores were unavailable for more than half 
of the sample. 

Gamoran (1996), in the analysis of urban high schools in the NELS:88, found no 
advantages in achievement in mathematics, reading, science, and social studies 
for either Catholic or secular private high schools compared with public magnet 
schools. Gamoran did not examine the different (or similar) school 
characteristics that could influence these student outcomes. 

Because previous research did not settle the question of Catholic school 
effectiveness, and given the current salience of school comparisons in policy- 
making, more research is needed. 

This study asks: Do students in Catholic secondary schools develop better 
academically than those in non-Catholic private schools? The primary purpose 
is to compare the effectiveness of Catholic schools with that of non-Catholic 
private schools in student academic development in reading, math, 
history/social studies, and science — the major subject areas in school curricula. 
The secondary purpose is to explore student-level and school-level factors 
influencing students' academic development. Finally, if any significant school- 
level differences are found, this study is designed to develop explanations for 
such institutional effects. 

How does this study differ from previous ones? While most previous Catholic 
school studies used public schools as a reference for comparison, this study 
compares Catholic schools with non-Catholic private schools. Such a 
comparison makes sense because private schools have organizational 
structures and climates distinctly different from those of public schools. The 
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institutional perspective focuses attention on “privateness” as an organizational 
characteristic, rather than social capital (e.g., network, parental involvement) in 
the school community. According to Chubb and Moe (1990), "All schools in the 
private sector have two institutional features in common: society does not 
control them directly through democratic politics, and society does control them 
- indirectly - through the marketplace" (p. 475). 

Most previous studies used mathematics achievement as the dependent 
variable, but this study examines four major subject areas, thereby more fully 
representing students' overall academic achievement in secondary school. 
Gamoran's (1996) study did include these four subject areas, but our study 
employed more extensive student-level and internal school-level variables. In 
addition, Gamoran's study included only urban schools, while this study included 
Catholic and non-Catholic private schools from all geographic locations within 
the U.S. Moreover, previous studies did not generate explanations for 
differential effects among schools, even when Catholic schools were found to be 
more effective than public schools. Our intention was to examine the reasons for 
any differences discovered, thus providing educators with important information 
for school reforms. 

Data and Methods 

Data and Sample 

We used data from the National Education Longitudinal Study of 1988 
(NELS:88) to create a two-level (student, school) hierarchical linear model. We 
selected students in private schools (Catholic schools, non-Catholic religious 
schools, and independent schools) from the 1988 Base Year Study of eighth 
graders and from the 1990 Follow-Up Study of tenth graders. We created a 
database for student characteristics and for institutional environment and 
characteristics by merging the student data file with the school component data 
file. This study included only students and schools that responded to both the 
1988 (base year) and 1990 (the first follow-up) surveys. The national scale of 
the survey data was extensive and the representation of schools by sector was 
justified by previous studies (Gamoran 1996; Rumberger 1995). 

We obtained usable data for 1 ,789 students in 1 44 schools: 841 students in 72 
Catholic schools and 948 students in 72 non-Catholic private schools. Among 
the non-Catholic private schools, there were 371 students from 31 non-Catholic 
religious schools and 577 students from 41 independent schools. In our 
preliminary analysis, we found that mean school characteristics and student 
characteristics of non-Catholic religious schools and independent schools were 
more alike than those of Catholic schools and non-Catholic religious schools. 
Thus, grouping non-Catholic religious schools and independent schools 
together seems justified. 

Variables 

Dependent Variables. The outcome (dependent) variables for the HLM analyses 
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are students' achievement scores in reading, mathematics, history/social 
studies, and science in the tenth grade. Achievement measures in the four 
subject areas are (1) reading comprehension, with 21 items consisting of five 
short passages followed by comprehension and interpretation questions; (2) 
mathematics, which consists of 40 items containing simple math, 
comprehension, and problem-solving items; (3) history/social studies, consisting 
of 30 items that assessed students' knowledge of American history, citizenship, 
and geography; and (4) science, consisting of 25 items from content areas of 
earth, life, and physical sciences. Using these composite achievement test 
scores makes academic achievement in reading, math, social studies, and 
science seem to be quite valid and reliable measures. 

Independent Variables . Catholic school status was the key independent variable. 
In addition, two kinds of independent variables were included in the analysis: 
student-level and school-level predictors. Student-level predictors are the base 
year achievement test scores in reading, math, history/social studies, and 
science; student's initial GPA; minority status (African American, Hispanic, or 
Asian-American); gender; family socioeconomic status (SES); risk factors; 
student's elective reading; student's religious affiliation (Catholic vs. non- 
Catholic); student's perception of each subject's usefulness (reading, math, 
history/social studies, and science); and the number of hours spent on 
homework. These variables were included to statistically adjust for students' 
differences in initial academic preparation, religious affiliation, and family SES. 
Because students' religion data was not collected in 1988 (8th grade survey), 
we used a student's religion (F1S81) in his/her 10th grade as an alternative. It is 
based on the assumption that a student's religion would not change much 
during the period. Some of the variables - for example, the number of hours 
spent on homework, the amount of elective solitary reading, and student's 
perception of each subject's usefulness - were not included in previous studies. 
We included them because our experience tells us that these characteristics 
can affect students' academic achievement and involvement in the subject 
areas, and thus would be worth exploring. The risk factors variable was included 
because some previous reports have noted that Catholic schools help to 
develop disadvantaged students (Hallinan 2000). In the NELS:88 study, 
students received a risk factor score of 0-6 based on how many of the following 
risk factors are present in their lives: lowest socioeconomic quartile, single- 
parent family, older sibling dropped out of high school (asked in the tenth 
grade), changed schools two or more times from first through eighth grade, 
average grades of C or lower from sixth through eighth grade, and repeated an 
earlier grade from first through eighth grade. 

School-level variables were divided into two categories: global and internal 
school characteristics. Global characteristics are defined in this study as 
geographical location, type of school, and school structural characteristics that 
are extremely difficult for school administrators to change or manipulate. Internal 
school characteristics are defined as characteristics that are relatively 
changeable and observable to students and faculty. Global school 
characteristics were included to adequately assess the effect of attending a 
Catholic school by controlling for other important global school characteristics. 
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Variables in this category were Catholic school status, enrollment size, average 
pre-test scores, average parental SES, percentage of minority students, and 
institutional location (urban, suburban, or rural). Aggregate pre-test scores and 
mean SES were treated as global school characteristics because these 
variables must be controlled to assess the effects of Catholic schools. Internal 
school characteristics were included to understand the reasons for any effects 
of Catholic schools. Examining internal characteristics can also help us 
determine the kind of school policy or environment that can positively or 
negatively affect students' academic development. The internal school variables 
were monitoring of academic progress, strictness of school rules, extent of 
school's encouragement for parental support and involvement, teachers' morale, 
students' morale, and teacher-student ratios. See Appendix A for the list of all 
the variables and their coding schemes. 

Analysis Procedures 

We began the analysis by generating descriptive statistics such as means, 
standard deviations, and correlations. Table 1 presents the means and standard 
deviations of variables included in HLM analysis, as well as the correlation 
coefficients between the variables and Catholic schools. Except for Catholic 
school, mean pretests, student's perception of each subject's usefulness, and 
parental education, the listed variables had significant positive or negative 
effects on at least one of the outcomes when included with other predictors in 
the HLM models. 

To test the null hypothesis that there is no significant difference in development 
of academic achievement in reading, mathematics, history/social studies, and 
science between Catholic and non-Catholic private secondary schools, we used 
hierarchical linear modeling. HLM has two major advantages over ordinary 
least-squares regression analysis (Bryk and Raudenbush 1992; Kreft and de 
Leeuw 1998). First, it lets researchers investigate, within a single analytic 
framework, hypotheses about the effects of both individual- (student) and 
institution- (school) level predictors on the outcomes of interest. Second, in 
working with nested data (i.e., students nested within schools), HLM takes into 
account dependencies among observations within clusters (schools) when 
estimating parameters of interest such as the effect of attending a Catholic 
school. If we ignore these dependencies, we may underestimate standard errors 
(Burstein 1980; Bryk and Raudenbush 1992). 

There are four kinds of HLM models for each subject area: unconditional one- 
way Analysis of Variance (ANOVA) models, student models, global models, and 
full models. The unconditional model includes no student- or school-level 
predictors. The student model consists only of individual students' 
characteristics (e.g., gender, academic preparation) or their family background 
(assessed at the eighth grade); it includes no school-level predictors. The 
student models provided the foundation on which to build the individual-level 
models of the subsequent global models and full models. We created the global 
models to test the study's hypotheses. As the name implies, the model includes 
global school characteristics such as school enrollment size, racial minority 
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proportion, and Catholic school status. However, students' aggregate eighth- 
grade academic achievement scores and mean parental SES were also 
considered for inclusion in the global model because not only individual 
students' initial achievement and SES but also their aggregate scores can 
account for important initial student body characteristics that are often beyond 
the school's control. The full model includes important internal school 
characteristics related to academic development; these characteristics also help 
to explain the reasons for the differences between Catholic and non-Catholic 
private schools. The variables in the models were selected in response to 
previous related studies and theories, researchers' intuitions and experiences, 
and statistical significance level (p = 0.10) in the exploratory models. The alpha 
level for the hypothesis testing was set at 0.10. 

For exploratory purposes, we attempted to determine whether there is any 
significant cross-level interaction effect. For example, in the regression analysis 
of reading achievement we checked interaction effects between initial GPA (at 
the individual level) and Catholic school (at the institution level). Finally, 
following similar analysis procedures, we created models that include almost the 
same variables across the four subject areas. "Almost" indicates that we had to 
model somewhat differently because there were subject -specific variables. For 
example, "pre-test reading" and "reading useful" should be included only in the 
models explaining reading achievement. The supplemental analysis models 
consist of all the variables that were included at least once in the HLM models 
(throughout Tables 2-5). The supplemental analysis helped us to recheck the 
findings of the original models and to understand the effects and patterns of 
independent variables across the models. 

Results and Interpretations: Examining the Effectiveness of 
Catholic Schools 

Means and standard deviations (Table 1) show that overall, students at non- 
Catholic private schools had higher pre-test and post-test means in all subjects 
than students in Catholic schools. Students at non-Catholic private schools also 
came from wealthier families, and their parents had higher levels of educational 
attainment than parents of Catholic school students. 

Table 1. Means, Standard Deviations, and Correlation Coefficients of 
Variables Included in HLM Analyses 


Variable list 

Catholic 

schools 

Non -Catholic 
schools 

All schools 

Simple r with Catholic 
schools 

Means 

SD 

Means 

SD 

Means 

SD 

Institution -level variables 

Enrollment 

1.33 

0.53 

1.64 

0.70 

1.49 

0.64 

-0.24 

** 

Catholic school 





0.50 

0.50 



Mean SES 

0.17 

0.43 

0.84 

0.38 

0.50 

0.52 

-0.64 

irk 

Mean pretest reading 

54.68 

4.77 

58.83 

4.40 

56.75 

5.03 

-0.41 

irk 

Mean pretest math 

53.00 

5.21 

60.42 

5.89 

56.71 

6.68 

-0.56 

irk 
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Mean pretest social 
studies 

53.85 

5.02 

58.14 

4.72 

55.99 

5.31 

-0.41 

kk 

Mean pretest science 

52.89 

5.42 

57.95 

5.55 

55.30 

5.74 

-0.48 

kk 

Teacher student ratios 

23.44 

5.25 

13.94 

5.46 

18.69 

7.15 

0.67 

kk 

Remedial reading 

6.61 

7.98 

3.42 

5.91 

5.01 

7.18 

0.22 

kk 

Parental involvement 

4.28 

0.74 

3.99 

0.88 

4.13 

0.83 

0.18 

k 

Monitoring academic 
progress 

4.70 

0.47 

4.12 

0.92 

4.75 

0.54 

-0.02 


Student morale 

4.11 

0.59 

4.27 

0.59 

4.17 

0.68 

-0.24 

k 

Strict school rules 

2.98 

0.41 

2.92 

0.39 

2.95 

0.40 

0.08 


Individual-level variables 

Pretest 

Reading 

55.25 

9.33 

59.38 

8.69 

57.39 

9.25 

-0.22 

kk 

Math 

53.86 

9.36 

61.05 

9.19 

57.58 

9.96 

-0.35 

kk 

History 

54.98 

8.88 

58.70 

9.12 

56.88 

9.27 

-0.20 

kk 

Science 

53.46 

9.18 

58.79 

9.95 

56.91 

9.97 

-0.26 

kk 

Posttest 

Reading 

54.67 

8.55 

59.21 

7.50 

57.03 

8.36 

-0.26 

kk 

Math 

54.42 

8.74 

60.31 

7.61 

57.47 

5.76 

-0.33 

kk 

History 

54.31 

8.69 

58.36 

8.50 

56.39 

8.84 

-0.22 

kk 

Science 

53.53 

8.97 

58.87 

8.73 

56.28 

9.27 

-0.28 

kk 

Female 

1.55 

0.50 

1.51 

0.50 

1.53 

0.50 

0.04 


Religion: Catholic 

0.82 

0.39 

0.15 

0.36 

0.46 

0.50 

0.67 

kk 

Parental SES 

0.26 

0.64 

0.88 

0.56 

0.58 

0.68 

-0.45 

kk 

Initial GPA 

3.22 

0.61 

3.23 

0.60 

3.23 

0.60 

-0.01 


Risk factors 

0.33 

0.59 

0.21 

0.46 

0.27 

0.53 

0.11 

kk 

Elective reading 

1.90 

1.52 

2.05 

1.54 

1.98 

1.53 

-0.05 

k 

Homework hours 

4.47 

1.34 

5.10 

1.67 

4.79 

1.55 

-0.19 

kk 

Reading useful 

3.12 

0.79 

3.23 

0.75 

3.18 

0.77 

-0.07 

kk 

Math useful 

3.31 

0.78 

3.23 

0.78 

3.27 

0.78 

0.05 

k 

Social studies useful 

2.54 

0.86 

2.77 

0.83 

2.66 

0.85 

-0.14 

kk 

Science useful 

2.83 

0.92 

2.94 

0.87 

2.89 

0.90 

-0.06 

k 

Parental Education 

3.52 

1.19 

4.56 

1.20 

4.06 

1.31 

-0.39 

kk 


Note: * p<0.05; ** p<0.01 (two-tailed) 

We gathered preliminary information using unconditional one-way ANOVA 
models (not shown in tables). The grand means were similar: 56.64 for reading, 
56.81 for math, 55.94 for history/social studies, and 55.65 for science. The 95% 
confidence interval of the means of these subjects falls between 54.71 and 
57.73. The ANOVA model also let us calculate an intra-class correlation 
coefficient, also called a cluster effect or the proportion of school-level variance. 
The intra-class correlation was 0.35 in reading, 0.41 in math, 0.33 in 
history/social studies, and 0.39 in science. In other words, about 35% of the 
total variance in reading, 41% in math, 33% in history/social studies, and 39% in 
science was located at the school level. 
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Tables 2-5 present the summary results of the three other models - student 
model (with level 1 predictors), global model (with the student-level predictors 
plus school-level predictors), and full model (with internal school-level predictors 
in addition to the global model variables). Except for the intercept, the random 
effects of student-level variables were fixed, because little variation was found 
across schools. All student-level variables were grand mean centered; 
therefore, the intercepts are unadjusted means of the outcomes. We will explain 
our main parsimonious HLM models first, then discuss additional findings from 
supplemental HLM models. 

Developing students' achievement in reading 

Table 2 presents the results of HLM analysis in reading achievement. Attending 
a Catholic school had a negative effect on developing reading skills between 
eighth and tenth grades compared with attending a non-Catholic private school. 
The student model consists of five student characteristics variables: eighth- 
grade reading achievement score, eighth-grade overall GPA, the number of risk 
factors, parental SES, and elective solitary reading. Only risk factors were 
negatively associated with the dependent variable. The associations and 
directions of the variables are consistent with our expectation. The five student 
characteristics explain about 31% of the total student-level variance. 

Table 2. Development of Students' Achievement in Reading 



Student Model 

Global Model 

Full Model 

Independent Variables 

b | se | t-ratio 

b | se | t-ratio 

b | se | t-ratio 

Institution-level variables 

Intercept 

56.994 0.194 

294.042*** 

55.489 

0.612 90.683*** 

53.017 

1.354 

39.166*** 

Global characteristics 

Enrollment 




0.750 

0.285 

2.636*** 

0.726 

0.281 

2.589*** 

Catholic school 




-0.767 

0.456 

-1.684* 

-0.695 

0.450 

-1.544 

Mean SES 




1.292 

0.542 

2.385** 

1.167 

0.539 

2.165** 

Internal characteristics 

Student morale 







0.608 

0.297 

2.044** 

Individual-level variables 

Parental SES 

1.046 

0.229 

4.576*** 

0.403 

0.269 

1.499 

0.405 

0.269 

1.504 

Initial GPA 

1.978 

0.239 

8.261*** 

2.063 

0.238 

8.653*** 

2.034 

0.238 

8.530*** 

Pretest reading 

0.543 

0.017 

32.593*** 

0.533 

0.017 

31.951*** 

0.534 

0.017 

32.023*** 

Risk factors 

-0.441 

0.242 

-1.818* 

-0.429 

0.241 

-1.781* 

-0.447 

0.241 

-1.855* 

Elective reading 

0.362 

0.087 

4.180*** 

0.386 

0.086 

4.480*** 

0.387 

0.086 

4.496*** 


Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 

Global models were created to test the study's hypotheses. The global model 
consists of three school-level variables (enrollment size, mean parental SES, 
and Catholic schools) in addition to student characteristics from the student 
model. The three school-level variables explained about 66% of the total school- 
level variance. Holding enrollment size, mean parental SES, and the five 
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student-level variables constant, we found that attending a Catholic school was 
negatively associated with developing students' reading achievement scores. 
The negative effect of Catholic school attendance was statistically significant 
(t=-1 .684, p<0.1), and null hypothesis 1 was rejected. In other words, if there are 
two students of comparable initial reading level, risk factors, and SES 
background, one attending a Catholic school and one attending a non-Catholic 
private school, and if the schools are similar in size and mean parental SES 
level, the student at the Catholic school is likely to have a slightly lower reading 
score than the student at the non-Catholic private school. 

Although there is no simple way to address the practical importance of statistical 
results, we present effect sizes to help readers understand some practical 
meanings of the expected mean differences of the four achievement outcomes 
between Catholic and non-Catholic schools. The global model of Table 2 shows 
that the expected difference in mean reading post-test scores between Catholic 
and non-Catholic schools is 0.767. We obtained a between-school standard 
deviation, 3.913, from the unconditional ANOVA model (not shown in the table). 
Plugging two measures into a commonly used effect size formula (to calculate 
standardized mean differences) (see Borg and Gall, 1989; Hopkins, Hopkins, 
and Glass, 1996; Kim, 1995; Kirk, 1996), we found a difference of 0.20 standard 
deviations (from -0.767/3.913) in students' reading scores between Catholic 
and non-Catholic private school sectors. In other words, non-Catholic private 
school students were estimated to score 0.20 standard deviations higher (or an 
8 percentile difference) in their reading achievement test, on average, than 
Catholic school students. Differences of this magnitude have practical 
importance especially because students' reading ability is considered the 
foundation for most academic subjects at school. 

The full model includes one additional school-level variable, student morale. 

This variable raised the school-level variance 1%, and the total variance 
explained by the four school-level variables was 67%. Student morale seemed 
lower in Catholic schools than in non-Catholic private schools, indicated by its 
means and correlation (r = 0.24, p < 0.05). When student morale was held 
constant, the negative effect of Catholic schools became insignificant (compare 
b coefficients and p levels of global and full models). Lower student morale 
seems to partially explain the negative effect attending Catholic schools has on 
reading achievement, although the coefficient change is not impressive. These 
findings need much further exploration in future studies. 

Developing students' achievement in mathematics 

Table 3 presents the results of the HLM models in mathematics. Attending a 
Catholic school vs. a non-Catholic private school made no significant difference 
in developing mathematics scores between eighth and tenth grades. The 
student model consists of five student characteristics: gender, students' Catholic 
religious affiliation, parental SES, students' eighth-grade GPA, and students' 
eighth-grade math score. These variables explain about 44% of the total 
student-level variance. Consistent with previous studies of public schools, being 
female was negatively associated with tenth-grade math scores. Again, eighth - 
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grade math score, initial GPA, and pre-test math score were important 
predictors for a student's tenth-grade math score. Notably, however, Catholic 
religious affiliation was a positive predictor for tenth-grade math score, even 
when students' initial academic and family backgrounds were statistically 
controlled. To our knowledge, the relationship between students' religious 
affiliation and their achievement scores has been addressed in only one study 
(Jeynes 1999). 

Table 3. Development of Students' Achievement in Mathematics 



Student Model 

Global Model 

Full Model 

Independent Variables 

b 

se 

t-ratio 

b 

se 

t-ratio 

b 

se 

t-ratio 

Institution-level variables 

Intercept |57.441 1 0.1 48 1 388.874*** 1 56.242 1 0.490 1 1 14.744*** |55.1 06 1 0.802 1 68.745*** 

Global characteristics 

Enrollment 




0.477 

0.223 

2.143** 

0.487 

0.221 

2.206** 

Catholic school 




-0.572 

0.406 

-1.408 

-0.721 

0.412 

-1.752* 

Mean SES 




1.327 

0.427 

3.111*** 

1.230 

0.427 

2.877*** 

Internal characteristics 

Parental involvement III III 1 0.300 1 0. 1 68 1 1 .783* 

Individual-level variables 

Female 

-0.644 

0.206 

-3.118*** 

-0.613 

0.204 

-3.008*** 

-0.623 

0.204 

-3.059*** 

Religion: Catholic 

0.433 

0.234 

1 .852* 

0.858 

0.265 

3.233*** 

0.858 

0.265 

3.236*** 

Parental SES 

0.620 

0.179 

3.470*** 

0.126 

0.206 

0.614* 

0.126 

0.206 

0.612 

Initial GPA 

1.962 

0.193 

10.153*** 

2.112 

0.193 

10.924*** 

2.100 

0.193 

10.68*** 

Pretest math 

0.667 

0.013 

50.645*** 

0.647 

0.014 

47.814*** 

0.648 

0.014 

47.914*** 


Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 

The global model consists of three global school characteristics: enrollment 
size, mean parental SES, and Catholic school status. These three variables 
explain about 79% of the total school-level variance. The sharp drop of the 
coefficient and significance of parental SES at the individual level occurred 
when mean parental SES was included at the institution level. Holding 
enrollment size and mean parental SES (as well as individual-level predictors) 
constant, Catholic school status was an insignificant (negative) predictor for 
math achievement scores. Null hypothesis 2 was not rejected. 

Concerning the practical significance of the school sector effect, there is a 
difference of 0.1 1 (from -0.572/5.056) standard deviations in students' math 
achievement scores. The between-school standard deviation 5.056 was 
obtained from the unconditional ANOVA model (not shown in the table; see the 
previous reading section). That is, non-Catholic private school students were 
estimated to score 0.1 Is standard deviation higher (or a 4 percentile difference) 
in their math achievement test, on average, than Catholic school students. This 
magnitude in math score does not seem to have great practical importance. 

The full model includes one more school-level variable: the school's efforts in 
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promoting parental support/involvement. It is not surprising that parental 
involvement positively affects children's academic development in mathematics, 
because this subject needs special attention and continuous efforts at home and 
school. It is, however, notable that the negative effect of Catholic schools 
increased and became significant (p = 0.079) in the full model when school 
effort in promoting parental involvement was held constant. The correlation of 
Catholic school and parental involvement was positive and significant (r = 0.18, 
p < 0.05). However, future studies should further explore the association and 
causal effects between math achievement, parental involvement, and Catholic 
school. The full model's four variables explain about 80% of the total school- 
level variance in tenth-grade math. 

Developing students' achievement in history/social studies 

Table 4 presents the three HLM models for history/social studies. Attending a 
Catholic school or a non-Catholic private school did not make a significant 
difference in developing history/social studies achievement between eighth and 
tenth grades. Again, we found some pattern of repetition in the student- and 
school-level variables included. The student model includes six variables: 
gender, parental SES, overall eighth-grade GPA, eighth -grade history/social 
studies score, elective reading, and eighth-grade students' perception of the 
usefulness of history/social studies subjects. These six variables explain about 
32% of the total student-level variance in tenth -grade history/social studies test 
scores. Students' perception that social studies and history are useful could lead 
them to devote more time and energy in these areas. We included elective 
reading as a variable because extensive reading beyond school materials could 
expand the knowledge base of historical and societal issues. The negative 
effect of being female on history/social studies achievement was unexpected 
and noteworthy. 

The global model includes three school-level variables: enrollment size, mean 
parental SES, and Catholic school status. These three variables explain about 
63% of the total school-level variance. Holding enrollment size and mean 
parental SES constant, we found that attending a Catholic school was 
negatively associated with developing students' history/social studies 
achievement scores. However, the effect of attending a Catholic school was 
insignificant, and null hypothesis 3 was not rejected. 

As for the practical significance of the school sector effect, there is a difference 
of 0.09 (from -0.376/4.003) standard deviation in students' history/social studies 
achievement scores. (The between-schooi standard deviation 4.003 was 
obtained from the unconditional ANOVA model.) In other words, non-Catholic 
private school students were estimated to score 0.09 standard deviations higher 
(or about a 4 percentile difference) in their history/social studies achievement 
test, on average, than Catholic school students. This magnitude in history/social 
studies score does not seem to have great practical importance. 

Table 4. Development of Students' Achievement in History/social studies 


r 


i 
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Student Model 


Global Model 


Full Model 


Independent Variables 

b se t-ratio 

b se t-ratio 

b se t-ratio 

Institution-level Variables 

Intercept 

56.430 

0.201 

281 .304*** 

54.870 

0.661 

83.024*** 

55.982 

0.993 

56.397*** 

Global characteristics 

Enrollment 




0.671 

0.307 

2.183** 

0.693 

0.298 

2.294** 

Catholic school 




-0.376 

0.492 

-0.764 

-0.052 

0.511 

-0.101 

Mean SES 




1.250 

0.582 

2.149** 

0.971 

0.599 

1.622 

Internal characteristics 

Teacher student ratios 







-0.080 

0.037 

-2.171** 

Remedial reading 







0.071 

0.029 

2.463** 

Individual-level Variables 

Female 

-1.897 

0.287 

-6.620*** 

-1.860 

0.284 

-6.547*** 

-1.847 

0.283 

-6.538*** 

Parental SES 

0.950 

0.238 

3.997*** 

0.390 

0.283 

1.375 

0.387 

0.283 

1.369 

Initial GPA 

1.905 

0.256 

7.455*** 

1.990 

0.255 

7.790*** 

2.008 

0.254 

7.893*** 

Pretest history 

0.582 

0.018 

32.557*** 

0.571 

0.018 

31.898*** 

0.572 

0.018 

32.027*** 

Social studies useful 

0.554 

0.162 

3.413*** 

0.542 

0.162 

3.348*** 

0.520 

0.162 

3.217*** 

Elective reading 

0.421 

0.091 

4.622*** 

0.443 

0.091 

4.875*** 

0.436 

0.091 

4.808*** 


Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 

The full model has two additional school-level variables: student-teacher ratio 
and the status of the school's remedial reading program. Obviously, students' 
scores in history/social studies are closely related to their reading skills. It 
appears that developing students' reading skills through remedial reading 
programs has multiple impacts on their academic development. Remedial 
programs seem to increase achievement in history/social studies. Catholic 
schools are more likely to have remedial programs than non-Catholic schools (r 
= 0.22). However, Catholic schools have higher teacher-student ratios than their 
counterparts (mean of Catholic schools: 23.44, SD = 5.25; mean of non-Catholic 
schools: 13.94, SD = 5.46), which were found to negatively affect students' 
development in history/social studies. With the inclusion of these two school 
characteristics (remedial reading program and student-faculty ratio), one 
positively and one negatively related to the outcome variable, the Catholic 
school effect became miniscule. The five school-level variables explain about 
66% of the total school-level variance. 

Developing students' achievement in science 

Table 5 shows the three HLM models for science. The type of private school 
attended made no difference in developing students' knowledge in science 
between eighth and tenth grades. The student model includes five individual 
student characteristics: female, eighth-grade GPA, eighth-grade science test 
score, parental SES, and hours spent on homework each week. Being female 
was the only negative predictor in the model and seems related to similar 
findings for mathematics. The positive effect of “hours spent on homework” 
seems to suggest, not surprisingly, that students who spend considerable time 
doing science homework or projects may learn more. Combined, the five 
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variables explain 29% of the total student-level variance. 

The global model includes only two school-level variables, mean eighth-grade 
science score and Catholic school status. These two variables explain a 
surprising 66% of the total school-level variance. No other global school 
characteristic considered (e.g., mean SES, enrollment size) had significant 
predictivity for the dependent variable, controlling for school mean science test 
score. The effect of attending a Catholic school was insignificant (p = 0.25), and 
null hypothesis 4 was not rejected. 

Concerning the practical significance of the school sector effect, there is a 
difference of 0.1 1 (from -0.561/5.1 12) standard deviations in students' science 
achievement scores. (The between-school standard deviation 5.1 12 was 
obtained from the unconditional ANOVA model.) That is, non-Catholic private 
school students were estimated to score 0.1 1 standard deviations higher (or a 4 
percentile difference) in their science achievement test, on average, than 
Catholic school students. This magnitude in science score does not seem to 
have great practical importance. 

However, students' science knowledge and test scores rise significantly when 
attending schools that have other students with high science scores. Judging by 
the correlation between mean science score and hours spent on homework per 
week (r = 0.22, p < 0.01), students surrounded by peers with high science 
scores may spend more time on homework. No significant change occurred in 
the coefficient of individual eighth-grade science scores, even when the mean 
score was included at the school level. This suggests that the individual score 
and the school's mean score have independent properties or contributions. 

Table 5. Development of Students' Achievement in Science 


Independent Variables 

Student Model 

Global Model 

Full Model 

b se 

t-ratio 

b 

se 

t-ratio 

b 

se 

t-ratio 

Institution-level variables 

Intercept 

56.237 0.225 

249.975*** 

42.854 

2.793 

15.341*** 

43.906 

3.690 

11.899*** 

Global characteristics 

Catholic school 




-0.561 

0.487 

-1.152 

-0.571 

0.474 

-1.204 

Mean pretest science 




0.244 

0.048 

5.078*** 

0.226 

0.048 

4.743*** 

Internal characteristics 

Monitoring academic 
progress 


■ 



■ 


0.683 

0.371 

1.843* 

Strict school rules 







-1.107 

0.530 

-2.086** 

Individual-level variables 

Female 

-2.399 

0.323 

-7.435*** 

-2.359 

0.292 

-8.078*** 

-2.357 

0.291 

-8.100*** 

Homework hour 

0.203 

0.096 

2.114** 

0.137 

0.093 

1.473 

0.134 

0.093 

1.450 

Parental SES 

1.408 

0.266 

5.301*** 

0.861 

0.266 

3.240*** 

0.849 

0.265 

3.207*** 

Initial GPA 

2.647 

0.318 

8.331*** 

2.802 

0.259 

10.809*** 

2.801 

0.259 

10.832*** 

Pretest science 

0.520 

0.20 

26.518*** 

0.493 

0.017 

28.286*** 

0.493 

0.017 

28.307*** 
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Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 

The full model consists of two internal school characteristics in addition to the 
variables of the global model. “School's emphasis on monitoring students' 
academic progress” was a positive predictor, and “schools with strict rules” was 
a negative predictor for the development of science scores. As shown in Table 
1 , these internal school characteristics do not differ between Catholic and non- 
Catholic private secondary schools. There was no significant change in the 
coefficients of the other variables when these variables were added to the HLM 
model. 

Throughout the four subject areas, we attempted to observe whether there is 
any significant cross-level interaction effect, but we found none. 

Supplemental HLM Analyses 

The models for supplemental HLM analyses were presented in Appendices B-1 
through B-4. With all the independent variables included in the original HLM 
analyses, HLM models were created and compared with the original 
(parsimonious) models. In other words, the supplemental models include all the 
independent variables chosen for any HLM model of four subjects, regardless of 
the variables' unique contribution to a different subject matter. To keep all 
achievement models comparable, reading useful, math useful, social studies 
useful, and science useful (to capture the impact of students' perception of 
utility) as well as mean pre-test reading, mean pre-test math, mean pre-test 
social studies and mean pre-test science were added to the corresponding 
achievement models. Although the coefficients of the variables that were 
originally in the HLM models were changed by including both significant and 
insignificant variables, the statistical significance level and signs of the 
independent variables rarely changed, except for the statistical significance level 
of Catholic school. 

Interestingly, in the supplemental global models, the negative effect of attending 
Catholic schools became stronger. In reading achievement, this negative effect 
became stronger, and its t-ratio increased from -1 .684 (p = 0.09) to -1 .956 (p = 
0.05). This provides a cross-validation of our major finding: that Catholic schools 
tend to produce lower student reading achievement scores than non-Catholic 
private schools. In the subject areas in which hypotheses were not rejected, the 
negative effect of Catholic schools on science achievement was more visible 
and became significant (p = 0.098). Even in history, the negative effect was 
more visible and very close to the cutoff point, although we do not reject the null 
hypothesis in conservative terms (p = 0.104). In short, there were indications 
that except for mathematics, non-Catholic private schools might be more 
effective in students' academic development than Catholic schools. 

Nevertheless, these results should be discussed cautiously, because the 
supplemental models tended to be overloaded with both significant and 
insignificant variables. 

Discussion and Conclusion 
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This study, because of its unique modeling and the consideration of important 
student- and school-level variables not included in previous studies, generated 
new findings in terms of both differences in achievement between Catholic and 
non-Catholic schools and possible explanations for such differences. In this 
discussion, we will address the major findings of the study and their potential 
implications. 

Reading achievement: A negative effect for Catholic schools compared 
with non-Catholic schools. A major finding of this study, not found in previous 
research, is the negative impact of Catholic schools on growth in reading 
achievement scores. The differential effect is not only statistically significant but 
is also practically important because of the impact students' reading 
comprehension abilities have on other subject matters. This was despite the 
finding that Catholic schools were more likely to have remedial reading 
programs (see Table 1), which presumably would have invested more resources 
on growth in this content area. At the same time, the presence of more remedial 
reading programs could suggest that more students in Catholic schools need 
this service compared with non-Catholic schools. The internal characteristics 
variable, student morale, may not provide a definite reason for the negative 
effect but is suggestive of an area for further study. 

Mathematics achievement: No significant difference between Catholic and 
non-Catholic schools. This study found that, when controlling for potentially 
confounding factors, Catholic schools do not have an advantage over other 
private schools in mathematics. The effect was very small, suggesting little 
practical significance. Attending a Catholic school or a non-Catholic private 
school did not make a significant difference in developing mathematics 
achievement scores. This result seems to conflict with those of other studies 
that found higher mathematics achievement in Catholic schools. However, in 
many previous studies using mathematics achievement as a dependent 
variable, Catholic schools were compared with public schools, and these studies 
seldom adjust extensively for potential confounding variables. Our finding about 
students' mathematics achievement was consistent with Gamoran (1996), 
although his sample included only urban schools. 

On the student level, the positive effect of being Catholic on mathematics 
achievement was a surprising finding. This study cannot identify whether 
students affiliated with Catholicism tend to study mathematics more, or whether 
other characteristics of Catholic students and their families contribute to this 
finding. Using NELS:88 data, Jeynes (1999) studied the effects of religious 
commitment on Black and Hispanic students' achievement in reading, 
mathematics, social studies, and science. He found that even when SES was 
included, religiously devout students performed better on all measures. 

However, attendance at a religious school did not explain the results. Further 
research is needed. In the full model, this finding proved to be partially 
contingent on a school's efforts toward parental support/involvement; therefore, 
school leaders should be aware of this factor and its implications for their 
practice. 
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History/social studies achievement: No significant differences between 
Catholic and non-Catholic schools. Attending a Catholic school or a non- 
Catholic private school did not make a significant difference in developing 
history/social studies achievement scores. The effect was very small, indicating 
little practical importance. On the student level, a surprising finding was the 
negative effect of being female on achievement in this subject. Females may be 
less interested in social studies because most major historical actors tend to be 
male, and social studies textbooks tend to emphasize “masculine” themes, such 
as wars and national politics. Explaining this finding is beyond the scope of this 
study, but educators and researchers should investigate further. 

In the full model, student-teacher ratios, school size, and remedial reading 
programs contributed to the model. It was not surprising that a lower student- 
teacher ratio might contribute to students' learning, particularly because 
between the eighth and tenth grades history/social studies content becomes 
more complex and conducive to projects entailing classroom activities and 
classroom discussion. However, it was surprising that a larger enrollment was 
positively related to achievement in this subject area. Perhaps a larger school's 
capacity to provide more specialized teachers, more curriculum options, and 
additional research resources in this subject explains this difference. Catholic 
schools were somewhat more likely to have remedial reading programs than 
non-Catholic schools, which, given the reading-intensiveness of history/social 
studies, may have contributed to achievement in this subject area. 

Science achievement: No significant differences between Catholic and 
non-Catholic schools 

Attending a Catholic school or a non-Catholic private school did not make any 
difference in developing science achievement scores. The effect was very small, 
suggesting little practical importance. However, it is important to note that in our 
supplemental analysis, the negative effect of Catholic school was more visible 
and statistically significant. 

Being female was the only negative predictor in the student model, which seems 
related to similar findings for mathematics. This suggests that schools need to 
work on closing this enduring gender gap. The positive effect of “hours spent on 
homework” indicates, not surprisingly, that students who spend considerable 
time doing science homework or projects learn more. As shown in Table 1 , the 
initial number of hours spent on homework is higher among students in non- 
Catholic private schools, which from a social capital perspective would suggest 
greater support for achievement in this area among non-Catholic private school 
parents. 

Monitoring students' academic progress was a positive predictor for growth in 
science achievement, while strict rules had a detrimental effect. These two 
variables seem to provide an educational implication: it is important to monitor 
students' academic progress, yet strict school rules could be detrimental in 
developing students' achievement in science. Perhaps, as constructivist 
theorists (Brooks and Brooks 1993) might claim, scientific exploration requiring 
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"hands-on" activity is less likely to flourish in a strict school environment. 

Other findings and implications 

Examining student- and school-level variables can provide educators and 
school administrators with additional insights. All the student models had three 
predictors in common: subject pre-test, overall eighth -grade GPA, and parental 
SES. Not surprisingly, eighth-grade pre-test score was the strongest predictor, 
and initial GPA, representing overall academic level, was the next strongest, for 
all four outcomes. Even when the effects of initial pre-test score and overall 
academic achievement were held constant, parental SES was still a very 
significant explanatory variable for all four outcomes at both the student and 
school levels. Students from higher SES backgrounds developed more, 
regardless of the type of school they attended. Several decades ago, studies in 
sociology of education found and established the impact of parental education 
on students' school success and the generational reproduction patterns of 
socio-economic status. 

Students' elective reading was a significant positive predictor of development in 
both reading and history/social studies. Reading beyond school requirements 
appears to enhance both reading skills and knowledge in social studies. In 
addition, a student's perception of the usefulness of history/social studies 
subjects was positively associated with history/social studies achievement. 
Although the utility variable was positively associated only with history/social 
studies, teachers may need to inform their students of the utility of school 
knowledge in their lives, especially given the changing global economy and 
increasingly competitive society. It is not surprising that having more risk factors 
would detrimentally affect students' academic achievement. However, future 
studies could take a closer look at the differences among risk factors in this data 
set (Horn, Chen and Adelman 1998). 

Interestingly, large school enrollment was positively associated with three 
outcomes: reading, math, and history/social studies. Although private schools 
tend to be small, we nevertheless found considerable variation in school 
enrollment size in the data. The data suggest that a moderate size of student 
enrollment seems to be necessary for student development. This finding would 
also support the benefits of smaller class sizes, although recent studies (e.g., 
Hoxby 2000) have called into question class size reduction as a public school 
reform issue. Connecting the negative effect of a school's teacher-student ratio 
on history/social studies with the positive effect of a large enrollment, we can 
induce a potentially desirable situation: keep a low teacher-student ratio at a 
moderately large high school. 

Limitations 

First, NELS data were not created particularly to conduct this type of study or to 
answer the questions that we raised. We acknowledge the potential for omitted 
variable bias because the necessary variables are simply unavailable in spite of 
our efforts to isolate all the possible confounding factors for the school effects. 
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Second, we acknowledge the problems associated with students' non-random 
selection into schools--a common issue of quasi-experimental design. Although 
the non-random choice issue might not be as serious as in studies in which 
Catholic schools were compared with public sector schools, school choices are 
not random and control variables would not simply adjust all the group 
differences. Nevertheless, our study attempted to adjust this non-random 
selection bias through the multi-level research design and analysis as well as by 
controlling for more extensive background characteristics than any previous 
studies examining Catholic school effects had done. 

Third, some may consider that two years is not a sufficiently long period for 
examining the Catholic school effect. We considered using the 1992 survey (the 
second follow-up) for students' outcome variables, but we realized there is too 
much vagueness and complexity in the data due to students' transferring from 
one sector to another during the four years of secondary schooling. Moreover, 
NELS surveys do not have all the necessary information to trace all of the 
transfers during the period. We conducted this study using the eighth-grade 
initial survey and the tenth-grade follow-up survey to reduce the vagueness of 
the findings as well as to maintain a relatively large sample size. 

Fourth, the data from the NELS:88 study can be considered somewhat dated, 
but it is the best available national database for this type of study. Although the 
organizational characteristics of educational organizations tend to change 
slowly, student populations in these two school sectors may be shifting. In the 
late 1990s it appeared that Catholic secondary school costs had risen sharply 
(Harris 2000), and there were signs that the Catholic school population was 
becoming increasingly elite (Baker & Riordan 1998). Successful legal efforts to 
include religious schools in school choice plans seem to favor growth in urban 
Catholic schools with low-income student populations. However, choice plans 
also favor the opening of a wider variety of non-Catholic private schools. This 
might change the demographic profiles of the two school sectors in future large 
database studies. 

Conclusion 

Our study provides education policymakers and the public with new insights to 
consider when making decisions about relative school effectiveness and 
allocation of resources to the private sector. We discovered that Catholic school 
students scored significantly lower than non-Catholic private school students in 
reading. Non-Catholic private schools were more effective in developing 
students' reading achievement from eighth grade to tenth grade than Catholic 
private schools. This finding was consistent in the main (parsimonious) and 
supplemental models. On the other hand, using the main HLM models, we 
found that attending a Catholic school does not make a significantly different 
impact on academic development in math, history/social studies, and science. 
The supplemental models, however, suggested that the effectiveness of 
Catholic schools could be worse than neutral. There were indications that 
except for mathematics, non-Catholic private schools might be more effective 
and beneficial than Catholic schools in developing academic abilities in the 
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subject areas investigated. Most previous studies finding a positive “Catholic 
school effect” were based on comparisons with public schools and often focused 
on a single subject, mathematics. Our results suggest, at the very least, that no 
claims should be made about the distinctive advantages of Catholic schools in 
academic achievement. 

Finally, we hope that future studies can make the discussion of Catholic school 
effectiveness more comprehensive by comparing public schools, Catholic 
schools, and non-Catholic private schools in the same multi-level research 
design. There is also a need for studies that compare Catholic schools with 
other religious schools. Coleman et al. (1982a) warned that research findings do 
not lead in any simple way to policy recommendations, and Witte (1992) issued 
a similar caution about basing school choice policy on comparisons of 
achievement across school categories. Comparison of school effectiveness will 
continue to be a volatile and important area of research not only because of its 
educational implications for student development, but also because of its policy 
implications. 
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Appendix A. Variables and Coding Schemes 


Variables 

NELS:88 source 
variables 

Coding scheme 

Institution -level variables 

Enrollment 

G8ENROL 

1='1 -49' students, 2=50-99,' 3=’1 00-1 99,' 4='200-299,' 
5='300-399,’ 6=400+'. 

Catholic school 

G8CTRL 

Recoded, 1=Catholic school, 0=non-Catholic school. 

Mean SES 

BYSES 

Aggregated, composite variable. 

Student morale 

F1C93G 

Aggregated, continuous scale. 

Promoting parental 
support/involvement 

F1C91E 

Aggregated, continuous scale 

Teacher-student ratios 

BYRATIO 

Continuous scale 

Remedial reading 

F1C30B 

Percentage of students receiving remedial reading 

Mean pretest science 

BY2XSSTD 

Aggregated, continuous scale. 

Monitoring academic 
progress 

F1C91H 

Range: 2-5; 3=minor emphasis, 5=major emphasis 

Strict school rules 

F1S7C 

Recoded. From 1=strongly disagree to 4=strongly 
agree. 

(Variables excluded in the original institution -level models) 

School minority 
proportion 

G8MINOR 

0=none, 1=1-5%, 2=6-10%, 3=1 1-20%, 4=21-40%, 
5=41-60%, 6=61-90%, 7=91-100% 

Mean pretest reading 

BY2XRSTD 

Aggregated score, continuous scale 

Mean pretest math 

BY2XMSTD 

Aggregated score, continuous scale 

Mean pretest 
history/social studies 

BY2XHSTD 

Aggregated score, continuous scale 

Mean pretest science 

BY2XSSTD 

Aggregated score, continuous scale 

Urban location 

G8URBAN 

Recoded, 1=urban school, 0=non-urban school 

Suburban location 

G8URBAN 

Recoded, 1=suburban school, 0=non-suburban school. 

Rural school 

G8URBAN 

Recoded, 1=rural school, 0=non-rural school. 

Teacher morale 

F1C93F 

Aggregated, continuous scale. 
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Remedial math 

F1C30C 

Percentage of students receiving remedial math, 
continuous scale. 

Individual-level variables 

Pretests 

Reading 

BY2XRSTD 

Reading standardized score taken during 8th grade, 
continuous scale. 

Math 

BY2XMSTD 

Math standardized score taken during 8th grade, 
continuous scale. 

History /social studies 

BY2XHSTD 

History/social studies standardized score taken during 
8th grade, continuous scale 

Science 

BY2XSSTD 

Science standardized score taken during 8th grade, 
continuous scale. 

Posttests 

Reading 

F12XRSTD 

Reading standardized score taken during 10th grade, 
continuous scale. 

Math 

F12XMSTD 

Math standardized score taken during 10th grade, 
continuous scale. 

History 

F12XHSTD 

History/social studies standardized score taken during 
10 grade, continuous scale. 

Science 

F12XSSTD 

Science standardized score taken during 10th grade, 
continuous scale. 

Initial GPA 

BYGRADS 

Grades composite (averaged and weighted self- 
reported grades, from A to D, across four subjects- 
reading, math, history/social studies, and science) 

Risk factors 

BYRISK 

The number of risk factors, range from 0 (no risk) to 6 
(6 risk factors) 

Elective solitary reading 

BYS80 

0=none, 1=1 hour or less per week 2=2 hours, 3=3 
hours, 4=4-5 hours, 5=6 hours or more per week. 

Female 

SEX 

1=male,2=female 

Religion: Catholic 

F1S81 

Recoded, 1=Catholic, 0=non-Catholic 

Parental SES 

BYSES 

Composite score 

Social studies are useful 

BYS71C 

Recoded, 1=strongly disagree, 2=disagree, 3=agree, 
4=strongly agree 

Homework hours 

BYHOMEWK 

The number of hours spent on homework per week. 
From 1=none to 8=21 and up hours 

(Variables excluded in the original individual-level models) 

Black 

RACE 

Recoded, 1=Non -black, 2=Black 

Hispanic 

RACE 

Recoded, 1=non-Hispanic, 2=Hispanic 

Asian-Pacific 

RACE 

Recoded, 1=non-Asian Pacific, 2=Asian Pacific. 

English is useful. 

BYS70C 

Recoded, 1=strongly disagree, 2=disagree, 3=agree, 
4=strongly agree 

Math is useful. 

BYS69C 

Recoded, 1=strongly disagree, 2=disagree, 3=agree, 
4=strongly agree 

Science is useful. 

BYS72C 

Recoded, 1=strongly disagree, 2=disagree, 3=agree, 
4=strongly agree 

Parental Education 

BYPARED 

From 1 =didn't finish high school to 6=Ph.D., M.D. 


Appendix B-1 Development of Students' Achievement in Reading 


Independent Variables 

Global Model 

Full Model 

b 

se 

t-ratio 

b 

se 

t-ratio 

1 1 
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Institution-level variables 


Intercept 

51.449 

2.852 

18.040 


50.970 

3.915 

13.020 


Global characteristics 

Enrollment 

0.771 

0.282 

2.733 

kkk 

0.748 

0.265 

2.825 

*** 

Catholic school 

-1.133 

0.579 

-1.956 

kk 

-1.203 

0.620 

-1.939 

k 

Mean SES 

0.748 

0.648 

1.154 


0.584 

0.660 

0.885 


Mean pretest reading 

0.078 

0.051 

1.538 


0.073 

0.052 

1.405 


Internal characteristics 

Teacher student ratio 





-0.010 

0.038 

-0.274 


Remedial reading 





0.013 

0.030 

0.443 


Parental involvement 





0.361 

0.228 

1.583 


Monitoring academic progress 





-0.394 

0.291 

-1.355 


Student morale 





0.598 

0.280 

2.134 

kk 

Strict school rule 





-0.356 

0.443 

-0.804 


Individual-level variables 

Female 

-0.138 

0.288 

-0.480 


-0.158 

0.289 

-0.548 


Religion: Catholic 

0.515 

0.410 

1.258 


0.532 

0.407 

1.306 


Homework hour 

- 0.000 

0.085 

-0.004 


-0.011 

0.084 

-0.128 


Parental SES 

0.408 

0.266 

1.534 


0.409 

0.266 

1.538 


Initial GPA 

2.064 

0.255 

8.078 

kkk 

2.030 

0.257 

7.908 

kkk 

Pretest reading 

0.525 

0.021 

24.452 

kick 

0.536 

0.021 

24.559 

*** 

Risk factors 

-0.425 

0.253 

-1.680 

k 

-0.434 

0.251 

-1.726 

k 

Reading useful 

0.066 

0.156 

0.425 


0.069 

0.155 

0.448 


Elective reading 

0.391 

0.090 

4.352 

kkk 

0.402 

0.089 

4.509 

kkk 


Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 

Appendix B-2. Development of Students' Achievement in Mathematics 


Independent Variables 

Global Model 

Full Model 

b 

se 

t-ratio 

b 

se 

t-ratio 

Institution -level variables 

Intercept 

55.738 

2.104 

26.487 

| *** | 

55.056 

3.041 

18.104 

| *** | 

Global characteristics 

Enrollment 

0.490 

0.185 

2.650 

kkk 

0.511 

0.190 

2.693 

*** 

Catholic school 

-0.555 

0.415 

-1.336 


-0.612 

0.452 

-1.356 


Mean SES 

1.264 

0.515 

2.456 

kk 

1.083 

0.505 

2.146 

kk 

Mean pretest math 

0.009 

0.039 

0.230 


0.017 

0.042 

0.406 


Internal characteristics 

Teacher student ratio 





-0.025 

0.026 

-0.979 


Remedial reading 





0.034 

0.033 

1.045 


Parental involvement 





0.328 

0.176 

1.871 

k 

Monitoring academic progress 





-0.128 

0.273 

-0.467 


Student morale 





-0.060 

0.210 

-0.286 


Strict school rule 





0.036 

0.390 

0.093 


Individual-level variables 
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Female 

-0.584 

0.222 

-2.631 

kkk 

-0.599 

0.223 

-2.692 

*** 

Religion: Catholic 

0.858 

0.299 

2.870 

kkk 

0.855 

0.300 

2.870 

*** 

Homework hour 

0.008 

0.064 

0.124 


-0.001 

0.064 

-0.022 


Parental SES 

0.114 

0.206 

0.552 


0.111 

0.206 

0.540 


Initial GPA 

2.083 

0.215 

9.682 

kkk 

2.082 

0.213 

9.785 

*** 

Pretest math 

0.643 

0.017 

38.699 

kkk 

0.643 

0.017 

38.723 

*** 

Risk factors 

-0.222 

0.182 

-1.224 


-0.231 

0.182 

-1.270 


Math useful 

0.159 

0.144 

1.102 


0.156 

0.143 

1.093 


Elective reading 

0.013 

0.055 

0.232 


0.017 

0.056 

0.306 



Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 

Appendix B-3. Development of Students' Achievement in History/social 

studies 


Independent Variables 

Global Model 

Full Model 

b 

se 

t-ratio 

b 

se 

t-ratio 

Institution -level variables 

Intercept 

56.098 3.045 

18.420 

j *** j 

58.305 

3.886 

15.003 *** 

Global characteristics 

Enrollment 

0.680 

0.345 

1.969 

** 

0.681 

0.334 

2.039 

** 

Catholic school 

-0.954 

0.587 

-1.625 


-0.599 

0.637 

-0.940 


Mean SES 

1.310 

0.696 

1.883 

* 

1.034 

0.708 

1.459 


Mean pretest social studies 

-0.018 

0.059 

-0.298 


-0.015 

0.056 

-0.264 


Internal characteristics 

Teacher student ratio 





-0.082 

0.036 

-2.295 

** 

Remedial reading 





0.070 

0.030 

2.335 


Parental involvement 





-0.010 

0.234 

-0.043 


Monitoring academic progress 





-0.139 

0.349 

-0.399 


Student morale 





0.009 

0.290 

0.030 


Strict school rule 





-0.187 

0.459 

-0.407 


Individual-level variables 

Female 

-1.836 

0.296 

-6.197 

kkk 

-1.822 

0.295 

-6.185 

*** 

Religion: Catholic 

0.824 

0.373 

2.210 

** 

0.809 

0.274 

2.164 

** 

Homework hour 

-0.013 

0.094 

-0.141 


-0.027 

0.093 

-0.292 


Parental SES 

0.337 

0.277 

1.213 


0.329 

0.276 

1.191 


Initial GPA 

1.961 

0.288 

6.819 

*** 

1.983 

0.286 

6.934 

*** 

Pretest social studies 

0.571 

0.022 

25.936 

"kick 

0.571 

0.022 

25.958 

*** 

Risk factors 

-0.261 

0.285 

-0.915 


-0.293 

0.284 

-1.029 


Social studies useful 

0.535 

0.162 

3.302 

kkk 

0.523 

0.161 

3.191 

*** 

Elective reading 

0.448 

0.102 

4.403 

kkk 

0.444 

0.102 

4.325 

*** 


Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 

Appendix B-4. Development of Students' Achievement in Science 
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Independent Variables 

Global Model 

Full Model 

b 

se 

t-ratio 

b 

se 

t-ratio 

Institution -level variables 

Intercept 

43.458 

3.431 

12.667 

kkk 

46.399 

4.315 

10.752 

kkk 

Global characteristics 

Enrollment 

0.437 

0.289 

1.510 


0.377 

0.281 

1.340 


Catholic school 

-0.970 

0.586 

-1.654 

* 

-0.794 

0.602 

-1.319 


Mean SES 

0.166 

0.790 

0.210 


-0.107 

0.777 

-0.138 


Mean pretest science 

0.223 

0.066 

3.365 

kkk 

0.187 

0.064 

2.909 

kkk 

Internal characteristics 

Teacher student ratio 





-0.054 

0.041 

-1.308 


Remedial reading 





-0.013 

0.034 

-0.393 


Parental involvement 





0.168 

0.271 

0.618 


Monitoring academic progress 





0.685 

0.302 

2.268 

kk 

Student morale 





-0.002 

0.322 

-0.005 


Strict school rule 





-1.249 

0.625 

-1.999 

kk 

Individual-level variables 

Female 

-2.350 

0.316 

-7.433 

"kick 

-2.341 

0.314 

-7.464 

kkk 

Religion: Catholic 

0.747 

0.330 

2.264 

kk 

0.752 

0.327 

2.300 

** 

Homework hour 

0.115 

0.099 

1.161 


0.104 

0.100 

1.040 


Parental SES 

0.776 

0.294 

2.641 

kkk 

0.766 

0.293 

2.611 

kkk 

Initial GPA 

2.705 

0.307 

8.806 

kkk 

2.707 

0.304 

8.902 

kkk 

Pretest science 

0.482 

0.021 

23.346 

kkk 

0.482 

0.021 

23.418 

kkk 

Risk factors 

-0.177 

0.281 

-0.632 


-0.219 

0.281 

-0.777 


Science useful 

0.193 

0.147 

1.315 


0.217 

0.151 

1.441 


Elective reading 

0.194 

0.095 

2.042 

kk 

0.199 

0.096 

2.069 



Note: *** p <= .01 ; ** p<=.05; * p<=.1 0 
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